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ABSTRACT 

Although it is commonly assumed that increases in 
mathematical knowledge and problem*solving skill alter one«s 
understanding of mathematical problems, little research exists to 
support this assumption, The present study investigated the 
relationship between mathematical background and problem perception 
in two experiments. Experiment 1 employed hierarchical clustering 
analysis to compare the way that experts (nine mathematics 
professors! sorted 32 mathematics problems typical of college 
mathematics courses with the way that novices (19 undergraduates) 
sorted the same problems* The experimenters assigned an a priori 
mathematical "surface structure 11 and a mathematical "deep structure" 
characterizations to each problem, "Surface structure" refers to the 
items described in the problems themselves. "Deep structure" refers 
to the mathematical principles necessary for solution, Results 
indicated that the two groups use different criteria for considering 
problems to be related, Experiment 2 compared changes in mathematics 
problem perception of students who took a computer course during the 
same time period* Training in problem solving resulted in the 
experimental group's problem perception being more differentiated and 
more like that of experts, Appendices contain the 32 problems used xu 
the experiments and the mathematics pretest* (Author/aiJ 
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Abstract 

Although it is commonly assumed that increases in mathematical 
knowledge and problem-solving skin alter one's perception (i.e., under- 
standing) of mathematical problems, little research exists to support this 
assumption. The present study investigated the relationship between mathe- 
matical background and problem perception in two experiments. Experiment 1 
employed hierarchical clustering analysis to compare the way that experts 
(mathematics professors) sorted 32 mathematics problems typical of college 
mathematics courses with the way that novices (undergraduates) sorted the 
same problems. The results indicated that the two groups use different criter- 
ia for considering problems to be related, Experiment 2 compared changes in 
the mathematics problem perception of students who took an Intensive mathe- 
matical problem-solving course with changes In students who took a computer 
course during the same time period, Training in problem solving resulted in 
the experimental group's problem perception being more differentiated and, 
more like that of experts, 
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Problem Perception and Knowledge Structure in 
Expert and Novice Mathematical Problem Solvers 

Problem-solving skill in mathematics rests in part on the ability to 
accurately perceive or understand a problem. Accurate perception permits one 
to identify the appropriate means to a solution, whereas inaccurate perception 
precludes such identification and instead leads one on a "wild goose chase," 
Despite the importance of this phase of problem solving, little research has 
been done on the acquisition of mathematical problem perception. The pur- 
pose of our research was to investigate how problem perception varies with 
experience and training. 

Outside of mathematics, problem perception has been found to develop 
with experience and to be directly related to Increased success at solving 
problems. Expert chess players have been found to perceive board positions 
in terms of patterns or board arrangements, whereas novices do not (de Groot, 
1965; Chase I Simon, 1973). Success at solving physics problems covaries with 
the relationships perceived among problems. Novices perceive similarities 
among problems according to their surface structure, e.g., wording, whereas 
experts perceive according to deep structure, e.g., the principles of physics 
(Chi, Feltovlch, & Slaser,flote 1). Evidence that differences In problem per- 
ception in physics contribute to the superior problem solving of experts over 
novices has yet to be reported. However, when students were taught some prin- 
ciples of elementary physics either in a hierarchical or non-hierarchical fa- 
shion, those given the hierarchical organization exhibited superior problem- 
solving performance (Reif and Eylon.Note 2). Finally, there is a body of 
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research regarding problem perception which shows that the mental representa- 
tion of a problem affects the processes directed towards its solution (Larkin, 
McDermott, Simon, and Simon, 1980). Surprisingly, little work has been directed 
to ascertaining how problem perception varies with the mathematical proficiency 
of problem solvers. Moreover, to our knowledge there has been no research into 
the cnanges in mathematical problem perception due to training in problem solv- 
ing. 

Research on problem perception in mathematics has shown, like that in 
other disciplines, that subjects with similar backgrounds perceive problems in 
similar ways. For example, high school students were asked (Kinsley, Hayes, 
and Simon, 1977) to examine a collection of algebra problems and to sort simi- 
lar problems (I.e., problems of a certain "type") into piles. Results from 
such stL-Hes reveal that students will cluster problems, often with substantial 
agreement (Kinsley, et al., 1977; Chartoff, 1977; and Silver, 1979). 

Moreover, problem-solving performance was found to covary with the de- 
gree to which a student's sorting data agreed with the experimenter's percep- 
tions of problem structure (Chartoff, 1977; Silver. 1979). Unlike research on 
problem solving i.n other disciplines, however, research on problem solving in 
mathematics has not examined how problem perception varies with experience 
across the range from novice to expert. 

The present research investigated mathematical problem perception as 
a function of problem- solving expertise in two experiments. Experiment 1 In- 
vestigated the problem perception of experts and novices in a sorting task 
comparable to that used in previous studies. Experiment 2 investigated whether 
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problem perception of novices would come to resemble that of experts, after 
the novices received intensive training In problem-solving techniques. Thus, 
Experiment 1 attempted to extend findings regarding differences in problem percep- 
tion between novices and experts to the domain of mathematics problems. Exper- 
iment 2 also may be viewed as an extension of research investigating the vari- 
ous effects of training on problem-solving ability (Lester, 1978; Schoenfeld, 
1979, 1980). However, it should be noted that Experiment I differs from pre- 
vious investigations of training effects In that it is the first to assess 
whether problem-solving training will alter novices' perceptions to be more 
like those of experts. 

Finally, it should be observed that the method of data analysis em- 
ployed here, Johnson's (1967) hierarchical clustering method, is superior to 
the methods used in the research cited above. In contrast to past studies, 
which report subsets of problems sorted together, this method represents sort- 
ing relationships for all problems simultaneously. Also the sorting results are 
represented in a hierarchical arrangement that makes explicit how frequently 
any particular pair of problems f s perceived by subjects as related. Through the 
use of more explicit analyses, the present study permits a richer interpreta- 
tion of mathematical problem perception than has been previously obtained. 

Experiment I 
Method 

Subjects 

Nine professors of mathematics from Hamilton College and Colgate 
University (hereafter referred to as experts) participated in the study with- 
out pay. A total of 19 undergraduates from Hamilton College (called novices), 
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all of whom had taken from 1 to 3 courses in college mathematics, also par- 
ticipated. Eleven served without pay as a condition of enrollment in a problei 
solving course; eight were paid a total of $20 each for their participation, 
Materials 

Thirty- two problems were chosen for the study. Those problems were 
chosen to be typical of those taught in mathematics courses prior to calculus. 
Each is accessible to students with a high school background in mathematics; 
none requires calculus for its solution. The experimenters assigned an a 
priori mathematical "surface structure" and a mathematical "deep structure" 
characterizations to each problem, "Surface structure" refers to the items 
described In the problems themselves, "Deep structure" refers to the mathe- 
matical principles necessary for solution, as Identified by the first author 
who is a mathematician. The problems are listed in Appendix A, The character!* 
zations for the problems may be seen in the clustering diagrams (Figures 1, 2, 
and 3). 

Each of the 32 problems was typed on a "3x5" card. Each subject read 
through the problems in a random order and decided which problems, if any, 
were "similar mathematically in that they would be solved the same way." A 
problem thit was deemed dissimilar to others was to be placed in a "group" 
containing one card. Subjects were told that they might return from 1 to 32 
"groups" to the experimenter. Novices performed the sorting task as a group. 
Due to insolvable scheduling problems, experts performed the task alone and 
at their convenience. All subjects finished the task in approximately 20 
minutes. 

Analysis 

Similarity matrices were derived, one for the novices and one for 
the experts. Each matrix represented the 32 problems and contained as its 
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i,j-th entry (i<j) the number of subjects who grouped together problems i 
and j. Thus, a similarity matrix consisted of 496 cells. First, a count 
was made of the number of problem pairs in the matrix receiving jtrong agree- 
ment, defined here as those pairs sorted by two-thirds or more of the sample. 
Second, each matrix was subjected to a clustering analysis with Johnson's 
(1967) hierarchical clustering routine, 

jasu I ts 

Initial inspection of the sorting data revealed that the experts sorted 
proolems more consistently than novices. One example of this consistency is evi- 
dent in the number of cells in the similarity matrix that represented strong agree 
ment among subjects (at least 2/3 of those sorti-ng the problems) about the similar 
ity of a oair of oroblems. In the present study there were more strong agreement 
cells -"cr experts (10) than for novices (4], t(26) ^ 10,45, p<.01. 

A more detailed examination of differences between expert and novice 
sorts was obtained with clustering analysis (diameter method) , The results 
are shown in Figures 1 and 2, for experts and novices, respectively. 

Insert Figures 1 and 2 about here 

The number of large branches for experts is seven, that for novices, five; 
tnis may indicate somewhat greater discrimination on the part of the experts, 
~ir mors important, however, are the problems deemed to be closely related, 
in this case those with a proximity level of it least 0.5, These 
strong clusters are bracketed together in Figures 1 and 2, It is Immediately 
apparent from a comparison of the bracketed clusters that the experts sorted 
:ne mathematics problems differently from the novices. 

Discussion 

The results of Experiment 1 showed clear differences in the sorting 
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of mathematics problems by experts and novices. This finding reproduces 
with mathematics problems the findings obtained previously with physics 
problems (Chi, et al . , Note 1). Also insistent with this previous re- 
search, the sorting by novices appears to depend more on surface character- 
istlcs of problems, while the sorting by experts depends on the deep mathe- 
matical properties of the problems. 

The different criteria for sorting by novices and experts may be dis- 
cerned in Figures 1 and 2. For example, the first novice cluster In Figure 2, 
•1,32,9} includes three problems which deal with whole numbers, even though 
the means of solution for those problems (see the "deep structure" character- 
izations) are radically different. In contrast, experts clustered only prob- 
lem 3 with problem 1: the solutions to these two problems, by induction, are 
almost identical. Similarly, three problems dealing with the roots of polynom- 
ials (10,29,24} were clustered by the novices although their deep structure 
characterizations were completely different and experts did not cluster them 
together. In further contrast/ consider problems 9, 15, and 17, all of which- 
have a deep characterization as "contradiction" problems. These were clustered 
together by experts and placed in three different clusters by novices. 

In some cases, the same clusters were produced by novices and experts. 
We maintain that these cases occurred for one of two possible reasons. First, 
the a priori knowledge of the students may have been sufficient to allow them 
to perceive the problems like experts: consider for example the cluster of 
problems (2,11,25, and 3} . Second, the surface and deep structures in some 
problem sets were coincident: for example, the pair {14,20} dealt with di- 
vision (factors) and was solved by using number representations (modular 
arithmetic) . 



«> 



Mathematical Problem Perception 

8 

To ascertain if our interpretations of sorting differences between 
experts and novices were correct, we asked one of our experts (JTA} to give 
the characterizations of problems that he sorted. Table 1 presents JTA's 
characterizations of the problems in Experiment 1, along with the deep struc- 
ture characterizations assigned by the first author. 



Insert Table 1 about here 



Inspection of Table 1 shows that of the 32 problems, there are only 
six discrepancies (problems 4,6,3,16,13,31) between tf a priori classification 
of the problems and the classifications by J.T.A. Moreover, three of these dis- 
crepancies (4*5,31) appear to really involve surface characteristics of the prob- 
lems. The expert's remarkably close agreement with the a priori characteri- 
zations supports the claim that these a priori characterizations reflect the 
deep structural properties of the problems, Given that the a prior i charac- 
terizations represent deep structure, we can assert with some confidence that 
the problem perception of experts is far more determined by deep structure than 
that of novices. 

Experiment 2 

The results of Experiment 1 indicate that experts perceive mathe- 
matics problems differently from novices. Since experts are distinguished 
from novices partly because of their problem-solving experience, it is reason- 
aola to hypothesize that appropriate training in problem solving would lead 
the novices' problem perception to become more differentiated and more like 
that of experts. Experiment 2 tested this hypothesis in the following manner. 
An experimental group was given an almost-month-long course In mathematical 
problem solving, A control group, of comparable background, was given course 
of similar length in structured programming, studying nonmathematical problem 
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solving techniques. Both groups sorted the problem set from Experiment 1 
and took a mathematics test Before and after their courses. We expected the 
hierarchical clustering analyses of the sorting data to i .icate that problem- 
solving training in mathematics alters problem perception, and that resulting 
patterns of problem solving for the mathematics group would mimic those of ex- 
perts . 

Subjects 

The nineteen novices of Experiment 1 participated In the study. Eleven 
,; thesa subjects served in an experimental group, explained below. These sub- 
jects had previously studied from one to three courses in college mathematics, 
including at least one course in calculus. The remaining eight subjects served 
in a control group. These subjects had also studied from one to three courses 
in college mathematics, including at least one course in calculus. Thus, at 
the outset of the study, the subjects in the two groups were approximately equal 
in experience in mathematical problem solving, 

Material s 

The deck of 32 problems from Experiment 1 was used also for this ex- 
periment. Additionally, two forms of a mathematics test, each in two sections, 
were constructed to assess mathematical problem-solving performance. One 
form of the first section is given in Appendix B. The second section was 
□art of a different study concerned with the teaching of problem-solving 
strategies. (The results are reported in Schoenfeld. Note 3, and will not 
be discussed here. ) 

Procedure 

The experiment was conducted during a three and one-half week "Winter 
Term" at Hamilton College. An experimental group (11 of the 19 subjects) took 
a course in 'Techniques of Problem Solving," taught by the first author. 
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The course met two and a half hours a day for 18 class days, with daily home- 
work assignments. The class stressed specific mathematical problem-solving 
strategies called "heuristics," and managerial techniques applicable to mathe- 
matical problem solving in general, (See Schoenfeld (1979; 1980} for details,} 

The control group (8 of the 19 subjects) took a course In "Structured 
Programming" which made comparable demands on the time of its subjects. The 
course taught a structured, hierarchical, and orderly way to solve problems in- 
volving the computer. As such, these subjects served as a control to compare 
with the experimental group in assessing the amount of math-specific knowledge 
and skills that might be acquired by the latter. 

Both the experimental and control groups followed an Identical proce- 
dure at the outset and end of the Winter Term, Within the first three days of 
the term, subjects were given a three and a half hour exam consisting of the 
mathematics tests described above and the card sort task described in Experi- 
ment 1. Similarly, within the last three days of the term, the subjects took 
an alternate form of the mathematics exam, and sorted the same set of prob- 
lems they had used in the first card sort, The problems in the test and in 
the card sort were directly related to the content of the course, In the fol- 
lowing sense: the problems could be solved by heuristic strategies studied in 
the course, which had been exemplified with problems of the same type (Schoen- 
feld, Note 3). As in Experiment 1, the clustering data was analyzed with John- 
son's (1967) hierarchical clustering routine, 

Results 

Each subject's performance on the mathematics tests was scored two ways. 
Strict scoring required a flawless solution per problem, giving 20 points for 
each of five problems solved correctly. Lenient scoring awarded 20 points for 
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each problem solved flawlessly, and partial credit (according to a predetermined 
scheme) for solutions that were partially correct. Table 2 presents the mean 
strict scores, and In parentheses the lenient scores, for experimental and con- 
trol subjects before and after the term. 



Insert Table 2 about here 



Inspection of Table 2 reveals that scores on the tests increased across 
the term (with strict scoring F(l,17) = 32.2, p<.001; with lenient scoring, 
F(l,17)' - 47.5, p<.001) > and were greater for experimental than for control 
subjects (with strict scoring. F(l,17) ^ 92.4, p<.001; with lenient scoring, 
F(M7] = 130.6, p<.001). The increase across the term was essentia lly only 
evident in the scores of experimental subjects (strict scoring, F(l 1 17) = 67,2, 
P<.001; lenient scoring, F(l,17) = 48.2, p<.001). These measures indicate 
strongly that the experimental group's problem-solving performance was 
significantly improved, the control group's more or less unchanged. 

One means of monitoring change in the experimental and control groups' 
performance is to correlate various of the novices' sorting matrices with the 
experts' sorting matrix from Experiment 1. Table 3 presents the correlations 
of the experts' matrix with each of the four matrices from Experiment 2, 



Insert Table 3 about here 



Inspection of Table 3 indicates the dramatic shift in the nature of 
the experimental group's problem perception, their post test sort correlating 
more closely with the experts' sort than any of the others, The nature of 
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that change also emerged from the clustering analysis. 

Two other correlations should be noted here* The sorts of control 
and experimental novices at the pretest were substantially correlated (r - ,650, 
df = 496, p<,QQl). This correlation shows that* as discussed earlier, both groups 
began the term with a fair amount of knowledge about the kinds of problems studied 
in the course. As expected, the correlation between experimental and control 
groups dropped significantly after instruction (4 = ,492, df = 496, p<.01)-- a 
consequence of the fact that the experimental group's sorts came to resemble 
the experts 1 , 

Finally, the post-Instruction sorting data from the experimental sub- 
jects were subjected to hierarchical clustering analysis. The results (dia- 
meter method) are shown in Figure 3. 



Insert Figure 3 about here 



Qeneral Discussion 

The correlations given in Table 3 demonstrate a substantial change 
in the experimental group's perceptions of problem relatedness, in conjunction 
with their Improved problem-solving performance, A comparison of the bracketed 
clusters in Figure 3 with those in Figure 1 (experts) and Figure 2 (combined 
novices before instruction) indicates dlearly that novices sorted the problems 
more -like experts after the winter term more than they did Initially, Further, 
it substantiates the hypothesis that the students' perceptions of problem 

* 

To save space the cluster diagrams for the experimental and control groups' 
sorts prior to Instruction have not been included. The matrix from which Fig- 
ure 2 was derived was strongly correlated with both the experimental pretest 
matrix (r ^ .918, df = 496, p<,0Ql} and the control pretest matrix (r = 889 
df =• 496, p< .001 ) . - ' r 
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relatedness were less based on surface structure* and more based on deep struc- 
ture, after instruction. 

Observe that of ten bracketed clusters, only five of the novices' clus- 
ters (50%) were homogeneous with regard to their deep structure characteriza- 
tions. Six of eight (751) of the experimental group's clusters were homogen- 
eous, as were eight of eleven (7335) of the experts' clusters. The experimental 
group's cluster {9,17,10} illustrates the change in perception. These three 
problems share the same deep structure (contradiction). However, as shown In 
Figure 2, these problems had appeared in three distinct clusters prior to the 
problem-solving instruction. Problem 10, moreover, appeared initially in a 
cluster homogeneous with regard to surface structure (polynomials, roots). 

The experimental group's post-instruction sorting, while more closely 
approximating the experts' sort, cannot be truly called "expert- like." The ex- 
perts' extended knowledge and experience allow them perceptions inaccessible 
to the novices. Consider, for example, the three bracketed clusters Including 
problem 1: novice 11 ,32,9}; experimental {1,3,21}':. expert {1,3}. The experi- 
mental group, drops problems 32 and 9, which were similar to problem 1 only in 
that they deal with whole numbers. Problem 3, which shares the same deep struc- 
ture as problem 1, is added. The mimicry of expert perceptions is not exact, 
however: problem 21 is added as well. The addition of problem 21 provides an 
indication of the "Intermediate" status of the experimental group. Problems 12 
and -21 were Included in the card sort to see if the experts would cluster them 
together. Underlying the experts' perception of problem 21 is the observation 
that multiples of 9 and multiples of 4 both include multiples of 36 (their in- 
tersection), and that one must compensate for subtracting the first two sets by 
adding the third. This is structurally similar to the rule N(AwB) ■ N(A)+N(B) 
-N(AriB) upon which problem 12 is based, This is a rather subtle observation. 
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While experts 1 experience with combinatorics problems might make such an ob- 
servation readily accessible, novices even with training cannot be expected 
to see such subtleties. In the absence of such knowledge, it is plausible to 
think that "looking for patterns" will help to solve problem 21— and thus to 
sort it with two -other "patterns- -problems. - - • - -- — - — ^" ' r 

The results of Experiments 1 and 2 support and extend previous re- 
search on problem perception. The novices 1 card sort indicated that. In the 
broad domain of general mathematical problem solving, students with similar 
backgrounds will perceive problems in similar ways. This is consistent with 
previous research in mathematics, which had considered only word problems In 
algebra (Hinsley, et al , , 1977; Chartoff, 1977; Silver, )979)* Like research 
in physics (Chi, et al., Note 1), it suggests that surface structure Is a pri- 
mary criterion used by novices in determining problem relatedness. Moreover,' 
it makes the simple but important point that students 1 problem perceptions change 
as the students acquire problem-solving expertise, Not only their performance, 
but their perceptions, become more like experts 1 , 

In general, questions regarding the deep structures in Individual dis- 
ciplines and the nature of experts 1 perceptions in tho^e disciplines are more 
complex than those regarding surface structures and novices 1 perceptions in 
them. Physics, for example, is a strongly ppfnctp1e-driven domain; one can speak 
of the principles which apply to a problem (e.g., "conservation of momentum" or 
"F = ma") without difficulty. The research by Chi, et al , (1980) Indicates that 
experts' problem perceptions and categorizations are strongly consistent with 
that structure. That is, the relevant principles of physics appear to form 
the basis for experts 1 considering problems to be related. In chess, it was 
helt that both the deep structure of the discipline and experts 1 perceptions 
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were largely princtple-basad (e.g., ^protect the center 11 ), However, research 
on chess perception (de Groot, 1965; Chase and Simon, 1973} served to indicate 
that experts 1 perceptions of routine problems (similar in a way to the routine 
physics and mathematics problems discussed above) may be based on the acquisi- 
tion of a "vocabulary" of known situations which is not necessarily principle- 
based. Mathematics does not appear to be as principle-driven as physics. Yet, 
the results described above indicate that deep structure may serve In large part 
as the basis for experts 1 perceptions of problem relatedness. Further research 
might profitably be directed towards the elucidation of deep structures In par- 
ticular disciplines, towards the elucidation of the nature of experts' percep- 
tions in those disciplines, and of the relationships between them. 
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Two Experts' Characterizations of the Problei 



ms 



£ EllprjL Characterization* 

1. Patterns; Induction 

2. Linear diophantine equation 

3. Patterns; induction 

4. Analogy (fewer variables) 

5. Diagram; analytic geometry 

6. Unclear; Herron's Formula or 

analytic geometry 
7* Special cases 

8, Special diophantine equation 

9. Contradiction 

10, Contradiction 

11, Linear diophantine equation 

12, Patterns; DeMorgan's Law 

13, Special cases 

14, Patterns; number representations 

15, Uniqueness; contradiction 

16, Special cases; diagram 

17, Uniqueness; contradiction 

18, Auxiliary elements 

19* Patterns; combinatorics 

20, Number representations 

21. DeMorgan's Law 

22, Easier related problem; patterns 

23. Diagram 

2,4. Special cases 

25. Linear diophantine equation 

26. Patterns; induction; number rep. 

27. Patterns; induction 

28. Diagram; analytic geometry 

29. Diagram 

30. Analogy 

31 . Analogy 

32. ■ Number representations 



Expert's Characterization 
Induction 

Diophantine equation 
Induction 

Note x=y=z; use (x+I ^2} a 
Analytic geometry 
Analytic geometry 



Factor out a 
Trial and error c 
Contradiction 
Contradiction; x %0, 
Diophantine equation 
Iterate (patterns) 
Cases; max 4 solutions 
Mod 8 d 

Contradiction 

Symnetry; analytic geometry 

Contradiction 

Analytic geometry 8 

Combinatorics 

Modular arithmetic* 1 

Combinatorics 

Iterate (patterns) 

1 ,2,3 collapses^ 

Factor 

Diophantine equation 

Iterate (patterns) 

Combinatorics; induction 

Analytic geometry 

Dumb problem (do it graphically) 

Consider 2 dimensional case (i.e. , analogy) 

Contradiction^ 

Mod 10 d 



ERLC 



Generated by the first author, AHS, who Is a mathematician. 



\ 
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NOTES FOR TABLE 1 



the solution described by JTA is that suggested by the "fewer variables" 
technique. 

b JTA's suggestion reduces the problem to the "special case" suggested by 
AHS. \ 

c here JTA discriminates between this and the other three diophantine equa- 
tions. JTA\ is a number theorist, and makes such distinctions. 

d what AHS calls "number representations" JTA calls "modular arithmetic." 

implicit in AH^'s assertion is a geometric approach. 

AHS's suggestion was that upon drawing the 25,50,75 triangle, one realizes 
that it collapses. 

9 after gaining inspiration from the 2-dimensional case, AHS makes his argu- 
ment by contradiction. ' 



Mathematical Problem Perception 

21 



Table 2 

Mean Solution Scores on 
Problems Before and After Term 

: > 

Before After 

Control 0(14) 0(24} 

Experimental 2(21 ) 25(73) 

Note: Parentheses contain scores obtained with a lenient 
scoring procedure (see text). 
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Table 3 

Correlations Between Sorting Matrices 
of Novices (Given at Left) with Expert Sort 

Control , Pretest 
Experimental , Pretest 
Control, Post Test 
Experimental » Post Test 

: With df ^ 496, all correlations are significant. All pretest' cor 
relations and the control post test correlation- are significantly 
less (p<-01) than the Experimental Novice Post Test correlation. 
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APPENDIX A 
PROBLEMS USED IN CARD SORT 



Show that the sum of consecutive odd numbers, starting with 1, is always a square 
For example, 

1+3+5+7 = 16 = 4 2 . 

You have an unlimited supply of 7 pound weights, 11 pound weights, and a potato 
which weighs 5 pounds. Can, you weigh the potato on a balance scale? A 9 pound 
potato? 

Find and verify the sum 

-L + 2 + 3 + ... + n 

1.2 1.2,3 1,2.3.4. 1.2.3,..(n+l). 

Show that if x,y, and z are greater than 0, 

(x 2 +l)(y 2 +iHz 2 +n . 
xyz %a * 

Find the smallest positive number m such that the intersection of the set of 
(Mh^s n^e^pty Plan6 ' ^ the "* ° f a11 P ° 1ntS at ^stance 3 from 

feren« 9 J hS (T^iV^L^i tHangl<S fo 7 a V r ! thmet1c P^Sression with d1f- 
ference d, (That is the sides are a, a+d, a+2d.) The area of the triangle is 

lem SS'tSVSfd iff?-"*™ 9 In "Tva thfS prob- 

Given positive numbers a and b, what Is 

« n Vn 
Lim (a n + b n ) ? 
n-H° 

In a game of "simplified football ,» a team can score 3 points for a field goal 
and 7 points for a touchdown. Notice a team can score 7 but not 8 points What 
is the largest score a team cannot have? p 5 " wna z 

Let n be a given whole number. Prove that If the number (2 n -l) is a prime 
then n is also a prime number. 

Prove that there are no real solutions to the equation 

10 8 6 4 2 
x ,u +x 0 +x°+x +x +1 = 0 

l L Czeci l' currency cons1 sts of coins valued 13 cents and 17 cents, can you 
a 20-cent newspaper and receive exact change? 
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FhJ ( ?fEH."fE nSScjI 1 elementS ^ th6n N(AWB) " ^^MfAnB). 
Construct, using straightedge and compass, a line tangent to two given circles 
Take any odd number-, square it; divide by 8, Can the remainder be 3? or 7? 

You are given the following assumptions: 

1) Parallel lines do not intersect; non-parallel lines intersect 
11 J Any two points P and Q in the plane determine an unique line 
which passes between them. 

?r °" e: XTpolnt' 1 ?" non - paral,el h ™< 4 »t intersect in an 

III llht?* X+ 0n ie\V d * ° VerlaPj * 4th the «™ r Qf one on the center of 
tne other. What is the maximum area of possible overlap? 

Show that if a function has an inverse, it has only one. 

Let P be the center of the square constructed on the 
hypotenuse AC of the right triangle ABC, Prove that 
BP bisects angle ABC. [See ftgure at rfght J 

How many straight lines can be drawn through 37 points 
in the plane, if no 3 of them lie on any one straight 
line? 

If you add any 5 consecutive whole numbers, must the re- 
sult have a factor of 57 

What is the sum of all #'s from 1 to 200, which are not multiples of 4 and 9? 
You may use the fact that 




tl+2+...+n) ■ 1/2 (n 



ii 





Your goal is to convert figure 1 to figure 2. You may 
move only one disk at a time from one spike to another, * 
and you may never put a larger disk on top of a smaller 
one. How to? 

Determine the area of a triangle whose sides are given as 25, 50, and 75. 
If P(x) and Q(x) have ''reversed 14 coefficients, for example 

P(x) * x 5 +3x 4 *9x 3 *11x 2 +6x+2, 

Q(x) - 2x S +6x 4 *llx 3 *9x 2 +3x*l, 
What can you say about the roots of P(x) and Q(x)? 

You have 2 unmarked jugs, one whose capacity you know to be 5 quarts, the other 
7 quarts. You walk down to the river and hope to come back with precisely 1 
quart of water. Can you do it? 



What is the last digit of 
1 ,000 times? . 



(■■■((J 7 ) 7 ) 7 .-.) 7 . 



where the 7th power is taken 
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27. Consider the magical configuration show at right, A 
In how many ways can you read the word "ABRACADABRA?" B S 

R R R 

28. A circular table rests in a corner, touching both A A A A 
walls of a room. A point on the rim of the table C C C C C 
is eight ^nches from one wall, nine from the other, A A A A A A 
Find the diameter of the table. 0 0 0 0 0 

29. Let a and b be given real numbers. Suppose that B B 
for all positive values of c, the roots of the equa- ~r R 
tion g A 

ax +bx+c = 0 



30. 
31. 

32. 



are both real, positive numbers. Present an argument to show that a must equal 
zero, ~ 

Describe how to construct a sphere which circumscribes, a tetrahedron (the 4 corners 
of the pyramid touch the sphere.) . 

Let 5 be a sphere of radius 1, A an arc of length less than 2 whose endpoints are 
on the boundary of S. (The interior of A can be in the Interior of S.) Show there 
is a hemisphere H which does not intersect A. 

Show that a number is divisible by 9 if and only if the sum of its digits is di- 
visible by 9, For example, consider 12345678: 1+2+3*4+5+6+7+8 ^ 36 = 4x9, 

So 12345678 is divisible by 9. 
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Appendix B 
Mathematics Pretest 



lL S rH H ,Sf. y , Sety W L def1ne Q(S) t0 be number of subsets of S 
Zto* 5"tA I 1! a T b ?r,° f 4l ements ' For ^mple: 'the "odd" 





Consider the set of aquations 



For what values of 
and for what values of 



"a" 



f ax * y = a 2 2 
(. x + ay = 1 J 

Is system fall to have solutions, 
there infinitely many solutions? 



y ■ 

ay 

does this 
a" are 



+n\L ■ J X u 12) recta ngul4>* grid, as illustrated 
to the right How many different rectangles can be 
drawn on G if the sides of the rectanglls mus? be 
grid lines? (Squares ire included, as are rectangles 
whose sides are on the boundaries of S j -" ang,es 




